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Abstract 

Understanding NP-complete problems is a central topic in computer science. This is why adi- 
abatic quantum optimization has attracted so much attention, as it provided a new approach to 
tackle NP-complete problems using a quantum computer. The efficiency of this approach is lim- 
ited by small spectral gaps between the ground and excited states of the quantum computer's 
Hamiltonian. We show that the statistics of the gaps can be analyzed in a novel way, borrowed 
from the study of quantum disordered systems in statistical mechanics. It turns out that due 
to a phenomenon similar to Anderson localization, exponentially small gaps appear close to the 
end of the adiabatic algorithm for large random instances of NP-complete problems. This implies 
that unfortunately, adiabatic quantum optimization fails: the system gets trapped in one of the 
numerous local minima. 
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a. NP-completeness. One of the central concepts in computational complexity theory 
is that of NP-completeness [1J. A computational problem belongs to the class NP if its 
solution can be verified in a time at most polynomial in the input size N, i.e., the verification 
requires not more than cN k computational steps, where c and k are independent of N. An 
NP-complete problem satisfies a second criterion: any other problem in the class NP can be 
reduced to it in polynomial time. Remarkably, such problems exist, many of them being of 
a great practical importance. The question of whether NP-complete problems are "easy to 
solve" , or in other words whether they may be solved in polynomial time, is one of the most 
fundamental open problems in computer science: this is the famous "P = NP" question [2J. 
It is commonly believed however that it is not the case, i.e., that solving such a problem 
requires a computational time which is exponential in N. 

b. Adiabatic quantum optimization. The discovery of an efficient (polynomial time) 
quantum algorithm for the factorization of large numbers — a problem in NP but not believed 
to be NP-complete — is a milestone in quantum computing |3j, as no algorithm is known to 
solve this problem efficiently on a classical (non-quantum) computer. However, this success 
was not extended to NP-complete problems. That was why the proposal of Farhi et al. |1] 
to use adiabatic quantum optimization (AQO) to solve NP-complete problems has attracted 
much attention since initial numerical simulations suggested such a possibility [5]. 

The basic idea of AQO is as follows: suppose that the solution of a computational problem 
P can be encoded in the ground state (GS) of a Hamiltonian Hp. To implement AQO one 
needs to construct a physical quantum system that is governed by a Hamiltonian H(s) = 
(1 — s)Hq + sHp where s is a tunable parameter, and Hq is a Hamiltonian with a known and 
easy-to-prepare ground state. The idea is to start with s = 0, initialize the system in the 
ground state of H(0) = Hq and increase s with time as s = t/T. According to the Adiabatic 
Theorem [6], slow enough variation of the parameter s = s(t) keeps the system in the ground 
state of the Hamiltonian H(s(t)) at any time t. Therefore, if T is large enough, at t — T 
the system would find itself in the ground state of H(l) = Hp and the problem would be 
solved. This model has since been shown to be equivalent to the standard (circuit) model 
of quantum computing [7j. Of course, as long as the computational time T remains finite 
there is a non-zero probability that the system would undergo a Landau-Zener transition [6] 
and end up in an excited state. In order to maintain the excitation probability less than e, 
the adiabatic condition requires that T ~ ~X2> where A(s) — Ep;g — Egg is the energy gap 
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between the ground state and first excited state (ES) of the Hamiltonian H(s). Therefore 
AQO is not efficient when A is small. More precisely, the adiabatic quantum approach to 
NP-complete problems can beat known classical algorithms (which require exponential time) 
provided that the minimal value of the gap scales as an inverse power of the problem size 
N. Previously, it was shown that the gap can become exponentially small under specific 
conditions, such as a bad choice of initial Hamiltonian [5J, E], or for specifically designed 
hard instances [TO], [TU [12]. In particular, it was recently argued that the presence of a 
first order phase transition could induce an exponentially small gap, and this effect was 
demonstrated for a particular instance of an NP-hard problem |13j . and later for planted 
instances of 3-SAT [14]. While these examples show that small gaps can occur for specific 
instances of NP-complete problems, one could hope that this is not the typical behavior, 
i.e., for randomly generated instances the gap could be small only with very low probability. 
This hope followed from numerical simulations H5J HE] where the minimum gap seemed to 
decrease only polynomially for small instances, up to iV = 124 for the latest simulations [17] . 
In this paper we show that this scaling does not persist for larger N. It turns out that as 
iV — > oo, the typical value of the minimal gap for random instances decays even faster than 
exponentially. As a result, the probability for AQO to yield a wrong solution in this limit 
tends to unity. 

c. Anderson localization. The appearance of exponentially small spectral gaps can be 
naturally attributed to the Anderson localization (AL) of the eigenfunctions of H(s) in the 
space of the solutions. Originally, AL implied that the wave function of a quantum particle 
in o?-dimensional space (d = 1, 2, 3, ... ) subject to a strong enough disorder potential turns 
out to be spatially localized in a small region and decays exponentially as a function of the 
distance from this region. Accordingly the probability for the particle to tunnel through a 
large disordered region is suppressed exponentially. To illustrate this, first note that the gap 
A can not vanish at any s unless there is a special symmetry reason. This is the famous 
Wigner-von Neumann non-crossing rule [15] : the curves that describe the s-dependence of 
two eigenenergies do not cross on the (E, s)-plane. This so-called level repulsion follows 
from the consideration of a reduced 2x2 Hamiltonian that describes two anomalously close 
energy states and neglects the rest of the spectrum. Let E\ and E2 be the diagonal matrix 
elements of the Hamiltonian, and V12 = be its off-diagonal matrix elements. We then 
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find the energy gap to be 

A = E E s - E GS = ^(E 1 -E 2 y + \V 12 \ 2 . (1) 

Now suppose that Ei(s) and E 2 (s) become equal at s = s c , as depicted in Fig. [I] We find 
that A > even for s = s c . This is known as a level anti-crossing. The minimal value of 
the energy gap is determined by the off-diagonal matrix element i.e., A min = \Vi 2 \ which is 
exponentially small under AL conditions. Accordingly the energy level repulsion between 
the localized states should be exponentially small in the spatial distance. Fig. [T] illustrates 
this situation schematically. At certain interval of s close to s c the difference Ei(s) — E 2 (s) 
is smaller or of the order of the tunneling matrix element V\ 2 . It is the interval where 
the anti-crossing takes place. Since Vi 2 depends exponentially on the distance between the 
wells, both the width of the anti-crossing interval and the minimum gap turn out to be 
exponentially small. The concept of AL was introduced more than 50 years ago in order to 
describe spin and charge transport in disordered solids |19j . Since then AL was found to be 
relevant for a variety of physical situations. It also turned out to exist and make physical 
sense in a much broader class of spaces than lZ d . Below we demonstrate that a phenomenon 
analogous to AL on the vertices of the iV-dimensional cube naturally appears in connection 
with AQO. 

d. Exact Cover 3. In order to explain the connection between the AQO approach 
to NP-complete problems and Anderson localization, we pick a particular NP-complete 
problem known as Exact Cover 3 (EC3), the same problem that was used for the early 
numerical simulations of AQO [5]. However, we believe that this analysis can be extended 
to any NP-complete problem. EC3 can be formalized in the following way. Consider N bits 
Xi,x 2 , . . . ,xn which take values or 1. An instance of EC3 consists of M triplets of bit 
indices (i c ,j c ,k c ) (the clauses), where each clause is said to be satisfied if and only if one 
of the corresponding bits is 1 and the other two are 0. A solution of a particular instance 
of EC3 is an assignment of the bits x = (x±,x 2 ,. . . ,xn) which satisfies all of the clauses. 
This problem can be assigned a cost function given by /(x) = J2 c ( x ic + x j c + x k c — 1) 2; 
each solution has zero cost and all other assignments have a positive cost. We consider 
a standard distribution of random instances, where an instance is built by picking the M 
clauses independently, each clause being obtained by picking 3 bit indices uniformly at 
random. The hardness of such random instances is characterized by the clauses-to-variables 
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FIG. 1: Schematic representation of a level anti-crossing. The energies of two quantum states \^f\) 
and 1^2) localized in distant wells can be fine-tuned by applying a smooth additional potential, 
(a) Before the crossing, the ground state is ^2) with energy close to E2(s), i.e., for s_ < s c , we 
have that Ei(s-) > Ez(s-), so that \GS(s-)) = {^2)- (b) After the crossing, the ground state 
becomes with energy close to £a(s), i.e. for s + > s c , we have that Ei(s+) < E2(s + ), so that 
\GS(s+)) = The ground states before and after the crossing have nothing to do with each 

other. At a certain interval of s close to s c , the anti-crossing takes place and the ground state is a 
linear combination of and {^2)- 

ratio a = M/N. There are two characteristic values of a: the clustering threshold a c \ and 
the satisfiability threshold a s [20J. For a < a c i, the density of the solutions is high and 
essentially uniform, while for a > a c i the solutions become clustered in the solution space 
with different clusters remote from each other (the distance between two assignments is the 
so called Hamming distance which is denned as the number of bits in which they differ). 
As a increases from a c \ to a s , the clusters become smaller and the distance between them 
increases. For a > a s , the probability that the problem is satisfiable vanishes in the limit 
N,M — > 00. It has been shown (21] that a s ~ 0.6263. We will be interested in instances 
with a close to a s , which only accept a few isolated solutions and are therefore hard to solve. 
More precisely, known classical algorithms can not solve such hard instances for a number 
of bits more than a few thousands, so that this is the regime where an efficient quantum 
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algorithm would be particularly desirable. 

e. Adiabatic quantum algorithm. In order to define an adiabatic quantum algorithm 
for EC3, we need to choose Hp and H . The problem Hamiltonian Hp for an EC3 instance 
can be obtained from the above cost function by first replacing Xi by the Ising variables 
ai = 1 — 2xi = ±1 and then substituting cr« by the Pauli Z operators &z , thus replacing 
the bits by qubits. The problem Hamiltonian becomes 

N N 

H P = MI-^J2 + i £ (2) 

i=l M = l 

where Bi is the number of clauses that involve the bit i, Jij is the number of clauses where 
the bits i and j participate together, and I is the identity operator. For H , we make 
the conventional choice H = — ^2i&x\ which corresponds to spins in the magnetic field 
directed along x-axis (Pauli X operators). For us it will also be convenient to modify the 
Hamiltonian H(s) as Hq C {\) = H P + XH . The parameter A = ^ changes adiabatically 
from A = +oo at the beginning t = to A = at t = T. 

f. Connection to Anderson Localization. We can now see the relevance of AL to the 
quantum system described by Hqc- Note that this Hamiltonian also describes a single quan- 
tum particle that is moving between the vertices of an N- dimensional hypercube. Indeed, 
each vector cr = (a^\ ai 2 \ . . . , crl ), where ai^ = ±1, determines a vertex of the hyper- 
cube, which is body-centered at the origin of the iV-dimensional space. Let |er) denote the 
quantum state of a particle localized at a site cr. The full set of these states forms a basis, 
in which the first term of the Hamiltonian is diagonal, while the second one describes a 
hopping of this fictitious particle between the nearest neighbors (n.n) 

£qc(A) = $>p(<t)|<t)<<t|+A l*X"'l- ( 3 ) 

cr cr cr ' n .n 



disorder 

Each on-site energy Ep(cr) is nothing but the cost function /(x) of the corresponding assign- 
ment cr. For random instances, the on-site energies are obviously also random, introducing 
disorder in the Hamiltonian. Hence, Eq. ^ describes the well known Anderson model, 
which was used to demonstrate the phenomenon of localization [19]. The only difference 
from more familiar situations is that lattices in ci-dimensional space, which have L d sites 
where L ^> 1 is the system size, are substituted by the iV-dimensional hypercube with 2 N 
sites, where N ^> 1. 




FIG. 2: Schematic representation of the creation of a level anti-crossing, (a) Before adding the 
clause, we have two assignments which are both in the ground state at A = but due to the no- 
crossing rule, at A > we have £i(A*) — £2 (A*) > 4. (b) By adding a clause satisfied by solution 
1 but not solution 2, we create a level anti-crossing since Ei(0) < £2(0) but Ei(A*) > £2 (A*). 
Insets: (a) If the clause is violated by the wrong solution, then no anti-crossing appears between 
these two levels, (b) However, other low energy levels can create other anti-crossings, leading to 
multiple small gaps. 

g. Anti- crossings in AQO. Now we are ready to discuss the fundamental difficulties 
which AQO faces. We will show that (i) the anti-crossings of the ground state with the 
first excited state happen with high probability and (ii) that the anti-crossing gaps in the 
limit N — > 00 are even less than exponentially small. Let us start with the first statement. 
An EC3 instance with a < a s typically has several solutions cr with Ep(cr) = 0. If a is 
close to a s there are few solutions at a distance of order iV of each other. The presence 
of multiple solutions imply that the ground state of Hqc(X = 0) = Hp is degenerate, but 
this does not contradict the non-crossing rule: Hp commutes with each of the operators 
b%\ so it satisfies a special symmetry which is broken for A > 0. Consider now a particular 
instance with M — 1 clauses accepting two solutions <T\ and cr 2 that are separated by n ~ iV 
spin flips. When A adiabatically changes from zero to a small but finite value the solutions 
evolve into eigenstates of the Hamiltonian, A) and |\&2, A) with the energies £i(A) and 
£2 (A). According to the non-crossing rule, a degeneracy of these two states at a finite A is 
improbable, i.e., the H term in Hqc splits the ground state degeneracy. This situation is 
sketched in Fig. [2[a). Suppose that E 2 (X) < £i(A), i.e. |^2,A) is the unique ground state 
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of the Hamiltonian Hqc(X). If we now add one more clause to the existing M — 1 ones, i.e. 
we add a term (xi M + Xj M + Xk M — l) 2 to the cost function leading to Hamiltonian Hp, both 
|<Ti) and |cr 2 ) remain eigenstates, but their eigenenergy can increase by either 1 or 4. With 
a non-zero probability the last clause is satisfied by &\ but not by cr 2 , i.e., Ep(cri) = while 
Ep{(T2) > 0, where Ep(cr) is the cost function of the new instance. Accordingly \cri) rather 
than |er 2 ) is the new ground state at A = 0. At the same time \^ 2 ,X) can still remain the 
ground state at large enough A if -E'i(A) > E^X), as shown on Fig. ^b). Such a situation 
corresponds to the anti-crossing of j^i, A) and |\I/ 2 , A) at certain A, as previously described 
in Fig. [T] Note that the addition of a clause to the cost function increases any eigenenergy 
of Hq C {X) by less than 4. To satisfy the condition Ei(X) > E 2 (X), it is thus sufficient to 
achieve a large enough splitting between the eigenvalues of the instance with M — 1 clauses: 
Ei(X) — E 2 (X) > 4. It turns out that if N ^> 1, this happens when A is small and one can 
use perturbation theory in A. 

h. Perturbation theory. To demonstrate this, consider the eigenstate which in the limit 
A — > evolves to |er). At small A its energy can be expanded in a series 

oo 

E(X,ct) =Ep(cr) + Y,^ m F {m \(T). (4) 

m=l 

We can show that each term in this sum scales linearly in N. For the energy Ep(cr) of 
an arbitrary assignment, we immediately have that < Ep < M = aN. As for the 
coefficients F^ m \cr), the cluster expansion [22] of the Hamiltonian Hqc implies that they 
may be expressed as a sum of ~ N statistically independent terms, each being of order 1. 
The key element to prove this is that since M/N = a is constant, with high probability each 
bit participates in a finite number of clauses as iV — > oo. As a result, all the coefficients Bi 
and Jij in Eq. Q are also finite: Bi = Y2j Jij — 0(1). In particular, when a is a solution we 
obtain F^ia) = B~ , which is therefore of order N. This statement is valid for F^ m \cr) 
with arbitrary finite m > 1: all of them can be presented as a finite sum of O(N) random 
terms, each one being of order unity. Let us now consider the perturbative expansion for 
the energy splitting between two solutions. Similarly to Eq. Q, we obtain 

oo 

E 1 (X)-E 2 (\) = J2^ 2m Fif, (5) 

m=2 

where = F( m Vi) - F^{(t 2 ) is a sum of O(N) terms of order 1. Each of the terms is 
random with a zero mean and hence the sums F^ averages to zero if iV is large. Therefore, 
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FIG. 3: Statistics of the square of the difference in energies of two solutions up to fourth order 
i.e. (F^) 2 - Linear fits confirm that the square of the energy difference scales as O(N). Inset: 
Statistics of the sixth order correction of the splitting (F$) 2 . Each data point is obtained from 
2500 random instances of EC3 with a ~ 0.62. Linear fits for the mean yield m 0.18 and 
« 0.65. 

it is {F^) 2 rather than F^™ which is proportional to N. We thus arrive to the conclusion 
that 

\E 1 (\)-E 2 (\)\ = VNj2^ m f im \ (6) 

m 

where the coefficients = 0(1) can be evaluated by the cluster expansion [22]. We have 
seen that F^(cr) = ^ B^ 1 for any solution cr, so that F^ = 0. However terms with m > 1 
do not vanish, making the splitting finite. On Fig. [3j we show the results of the statistical 
analysis of the numerical calculations of the coefficients (F^) 2 and (F^) 2 , with linear fits 
confirming their scaling O(N). For small A, we can restrict ourselves to the leading term 
(m = 2) in Eq. (|6p. Accordingly in the N — > oo limit, the splitting |£a(A) — -^(A)] exceeds 
4 as long as A > A*, with 

A, = V2 (/ (2) )- 1/4 iV- 1/8 , (7) 

and A* 1 so that we can neglect higher orders, A* 1 (the validity of this approximation 
will be discussed in the next paragraph). From Eq. ([7]), it follows that the anti-crossing 
probability for the instance with M clauses is finite provided that A > A* ~ N^ 1 ^ 8 . How 
big is the gap A of such an anti-crossing? As explained above, we can evaluate the gap by 
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considering the matrix element V12 between the states |^/i,A) and |^2, A) corresponding to 
the two assignments, at the value A where the anti-crossing occurs. Note that if the two 
assignments <j\ and cr 2 satisfying the (M — 1) clauses are separated by a distance (number 
of flips) n, this matrix element only appears at the n-th order of the perturbation theory, 
i.e. it is proportional to A ra : 

Vb, = \ n Y. (nLi£p(*L fc) )) _1 + 0(A" +1 ) (8) 

tr 

where the sum is over all "trajectories" tr - all possible orders of the n spin flips needed 
to transform <Ti into cr 2 , <x^/ is the assignment along a particular trajectory that appears 
after k flips and Ep(cr^) is the cost function of this assignment. Therefore we can estimate 
the matrix element and thus the anti-crossing gap as V12 < w(n)X n . The prefactor w(n) 
reflects the fact that many (~ n!) trajectories contribute to the sum in Eq. ([8]). For a 
typical trajectory Ep(cr^) = 0{k) for k < n/2 and Ep(cr[^) = 0(n/2 — k) for k > 
n/2. As a result the product of Ep(cr^)) in Eq. |8) is also ~ n\. The factorials thus 
cancel each other and w(n) can not increase faster than A n with some constant A ~ 1. 
Therefore, V12 < (A\) n . Combining this with Eq. ([7]), we see that an anti-crossing at 
A close to A* yields the minimum gap as small as A min ~ exp[— (n/8) \n(N/N )], where 
No = l6A 8 (f^)~ 2 = 0(1). We can estimate the distance n between the assignments as 
v(a)N, where v (a) ~ (4/9)(l — exp(— 3a)), and obtain the final form of the minimal gap 
estimation 

A min ~ exp[(-v(a)N/8) \n(N/N )]. (9) 

One can see that as iV — > 00, the gap indeed decreases even faster than an exponential - 
statement (ii). This implies that the adiabatic computation time exceeds exp(iV). In Fig. |4| 
we have plotted an anti-crossing for a particular instance with iV = 200 generated during 
our numerical simulations. The figure shows two energy levels (estimated by fourth order 
perturbation theory) corresponding to assignments separated by 60 bit flips, and crossing 
at A ss 0.51. 

i. Applicability of the perturbation theory. Our main result - the estimation of the 
minimal gap (Eq. (|9])), is based on the perturbative expansion for the energies (Eq. Q) and 
the matrix element Vn (Eq. (l8l). Is the perturbation theory in A always applicable? At first 



1 1 

sight Eq. (8) becomes meaningless if Ep = for any of the intermediate assignments cr tr . 
In this case there is an avoided crossing between the states corresponding to the assignments 
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FIG. 4: Simulation of a level anti-crossing for a random instance with N = 200 bits and a ~ 0.62, 
obtained by fourth order perturbation theory. The figure shows the energies of two assignments 
after adding a clause to the final Hamiltonian. The added clause is satisfied by assignment 1 but 
not by assignment 2. The figure shows a level crossing similar to the cartoon in Fig. [2} Inset: To 
make the crossing more apparent, we plotted the energy differences E\ — E<i and E<i — E\. The 
crossing occurs at A ~ 0.51, and the corresponding assignments are at distance n = 60 from each 
other. 

and formally perturbation theory fails in the vicinity of this 
anti-crossing point. This apparent difficulty can be overcome by considering only a finite 
time T for the evolution. This is equivalent to adding imaginary parts ii] « i/T to the 
energies. For the AQO algorithm, it is the computation time T that determines rj. Since we 
are considering the N — > oo limit, we have that T — > oo and thus rj — > 0. This is the limit 
that was shown to be relevant for the localization problem [T9|l23]. The celebrated discovery 
of Anderson was that if the limit r\ — > is taken after the volume (here N) tends to infinity, 
and A is small enough i.e., A < A cr , the spectrum of the Hamiltonian described in Eq. ^ 
remains discrete (all states are localized) and thus the second term in Eq. ^ (the kinetic 
energy term) can be treated perturbatively. As soon as A > A cr , there appears a strip of 
extended states in the middle of the energy band which widens as A increases further. States 
within this strip are not perturbative because the number of the trajectories connecting two 
points in a rf-dimensional space (for finite d) increases exponentially with distance. The 
large number of terms in the expansions like Eq. d8| overwhelms the smallness of A n and 



<Ti and (Tfr) (such as in Eq. ( 
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the perturbation series thus diverges for A > A cr . For a d-dimensional space, the critical 
value A cr is believed to be (in our units) of the order of A cr ~ 1/ log d [2HI2S]- We have seen 
that the AQO algorithm for problems like EC3 can be mapped to the Anderson model on 
an N- dimensional hypercube. Then, the number of trajectories increases with the length n 
as n\ ~ n n e~ n , i.e. even faster than an exponential. However, as we already mentioned, the 
n n factor cancels with the same factor in the products of the energy in the denominators 
of Eq. (|8j). Accordingly, A cr can still be estimated as A cr ~ 1/ log AT, which, together with 
Eq. ([7p, implies that anti-crossings appear for A* <C A cr when iV>l. Moreover, at A < A cr 
all of the states are supposed to be localized. The AQO algorithm involves only low energy 
states, which remain localized much longer than the middle-band states with the energies 
~ N. Therefore, it is quite likely that the exponentially small gaps appear even at A ~ 1. 

j. Conclusions. We finish our discussion with the following observation. We monitored 
two assignments that satisfied M — 1 clauses and added an extra clause to create a small 
gap at finite A. Of course, for randomly selected clauses this happens only with a finite 
probability and the situation sketched in the inset in Fig. |2](a) is also possible. One could 
thus hope [H] that the AQO algorithm can find the solution with a sizable probability. 
Unfortunately, this is not the case. Indeed, let us adopt the most conservative limitation on 
the perturbative approach A cr ~ 1/ log N and consider the spectrum at A* <C A cr ~ 1/ log N. 
According to Eq. ^ all states in the energy interval [0, e] with e ~ \^NX 4 ^> 1 have similar 
chances to evolve into the ground state at A = 0. This means that typically the ground 
state undergoes u(e) anti-crossings (participates in v(e) anti-crossing gaps) as the parameter 
evolves from to A (see the inset of Fig. [21(b)). Here v(e) is the number of states, whose 
energies at the given A differ from the ground state energy by less than e. Taking into 
account that v(e) increases with e exponentially and that the probability to completely 
avoid anti-crossings (the probability to have a gap of size e separating the ground state from 
the rest of the spectrum) is exponentially small in z/(e) we conclude that this probability is 
indeed negligible. Therefore, these findings suggest that there is no chance of obtaining the 
solution of the problem in polynomial time using the AQO algorithm for random instances 
of the Exact Cover 3 problem. We also believe that the methods described in this article 
can be applied to other similar NP-complete problems, such as 3-SAT. 
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